COLOR IMAGE PROCESSING METHOD AND APPARATUS THEREOF 

REFERENCF TO RFl ATFQ appi ir.ATinM 
This application claims the benefit of U.S. provisional application Ser 
No.60/1 18.741. filed Feb. 5. 1999, the disclosure of which is incorporated herein by 
reference. 

BACKGROI IND OF THF IN]\/PMT|r>M 
1 . Field of the Invention 

The present invention relates to an image processing method, and more 
particularly, to a color image processing method which is a pre-processing method 
required for retrieving a color feature descriptor used in indexing and searching a 
color image. 

2. Description of the Related Art 

In object-based digital image compression standards such as MPEG-7 color 

feature descriptors for indexing and searching color images are defined. A color 

feature descriptor is retrieved from an input image. 

In the color image processing method, in order to retrieve a color feature 
descriptor, an input image is segmented into a plurality of regions, quantized color 
vectors tor the segmented regions are obtained, and then the color feature 
descriptor of a pertinent region is determined using the quantized color vectors 
However, noise components may exist in the image. Also, good color quantization 
IS important in accurately representing color information in the image. Thus pre- 
processing such as filtering or noise removal is necessarily performed before 
quantization. 

Conventionally, in order to remove noise from an image, filtering methods 
such as vector median filtering or vector directional filtering have been employed 

However, since filtering method used in conventional color image processing 
methods are uniformly applied to an image, non-noisy pixels may be modified, which 
causes edge blurring in the original image. 



1 



SUMMARY OF THE INVENTION 

To solve the above problem, it is an objective of the present invention to 
provide a color image processing method and apparatus, by which filtering can be 
performed without edge blurring of the color image and noise in the color image can 
be eliminated, the method being a pre-processing method required for retrieving a 
color feature descriptor for indexing and searching the color image. 

It is another object of the present invention to provide a computer readable 
medium having a program executable by a computer to perform the color image 
processing method. 

A feature of the present invention is embodied by a color image processing 
method includes the steps of (a) sorting image pixels according to the color distance 
between the image pixels and a central pixel, (b) grouping the sorted pixels into 
groups in which the difference in the intragroup color distance is minimum and the 
difference in the intergroup color difference is maximum, and (c) performing filtering 
by replacing a central pixel value with a predetermined pixel value determined by 
pixel values of pixels in the groups. 

The color image processing method may further include the step of defining a 
window having a predetermined size within an input color image, wherein the image 
pixels are pixels within ^^^^y^^^^^^^^ 

Before -the-step (b^, the method preferably further includes the step of 
removing pixels having-a-difference in color distance from the central pixel greater 
than or equal to a predetermined threshold, with respect to a predetermined number 
of pixels at the beginning and latter parts among the sorted pixels. 

The predetermined number is preferably less than or equal to L/2, in which L 
is a predetermined positive number indicating the size of an LxL window. 

■ftgsfnrP-thP 5;tP:fr(h)-- thp - mp thQd prefe cabt y f tt fther i nc l udos tho -step of 
r e movin g pivr4 <H=t ^" ' ^g ^ Hiffnrnnnn in - r o l nr H i Q toftf^tf^-^c orn thfa r.P ntrf = ^l p jX ftl g r'^atQ'" ^ 

than or e q ua l to a p r edetemiii -rea inresnoic, wiin i' fe^spBcL lu d pi e d e t erminod numh eiL^^ 
■Qf-^kefs-aHh e beg in n i ng and - tette r par ts among the sonea pixersr^ 

Also, the step (b) may include grouping the sorted pixels using a function 
based on a Fisher's discriminant estimation method. 



The step (b) may include the sub-steps of (b-1) setting a first group consisting 
of 0th through pixels, and a second group consisting of rth through Kth pixels, 

wherein / is an integer from 0 through K and K=L^-1 . (b-2) obtaining the respective 
averages of the color distance differences for pixels of the first and second groups 
5 by the following Expressions: 

c^.O) = yf dj(n) a/ij = Tt/t— Z d/nj 

and + 1 I j=i ^^j_3j obtaining the 

respective variances of the color distance differences for pixels of the first and 
Pj second groups qro - obterifre ehby the following Expressions: 



and . (b-4) 



[fl 10 calculating a value J(i) by the following Expression, using the obtained average and 



vanance: 

2 

a,fi}- a^fi) 

J(i) - 



^1 (0 + ^2 (0 and (b-5) obtaining the value of / which makes J(i) 



maximum by the following Expression: 

org 

m(nj= {maxJ(i)} 

i , and selecting pixels ranging from a pixel having a 

15 small color distance to a pixel having the obtained value of / to determine the same 
as a peer group P(n). 

Also, after the step (b-5), the method may further include the steps of 
selecting / pixels ranging from the pixel having the minimum color distance among 
the pixels sorted according to the color distance from the central pixel and setting 

20 the largest value of the color distances of the selected pixels as the maximum color 
distance within the peer group, and performing color quantization by weighting the 
color vectors of the respective pixels by exp(-T(n)), wherein T(n) is the maximum 
color distance within the peer group. " 
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Alternatively, after the step (b-5), the method may further include the steps of 
selecting / pixels ranging from the pixel having the minimum color distance among 
the pixels sorted according to the color distance from the central pixel and setting 
the largest value of the color distances of the selected pixels as the maximum color 
distance within the peer group, and obtaining the average of T(n) values of the 
whole image and performing color quantization using a value obtained by 
multiplying the average with a predetermined constant as the number of clusters, 
wherein T(n) is the maximum color distance within the peer group. 

Also, after the step (b-5), the method may further include the steps of 
selecting pixels whose number corresponds to the size of the peer group, ranging 
from the pixel having the minimum color distance among the pixels sorted according 
to the color distance from the central pixel and setting the largest value of the color 
distances of the selected pixels as the maximum color distance within the peer 
group, and weighting the color vectors of the respective pixels by exp(-T(n)), 
wherein T(n) is the maximum color distance within the peer group, and performing 
color quantization using a value obtained by multiplying the average of the T(n) 
values of the whole image with a predetermined constant as the number of clusters. 

The step (c) preferably includes replacing the central pixel Xo(n) with a new 
pixel Xo(n) by the following Expression: 



where Pi(n) are the pixels constituting the peer group and are predetermined 
weights corresponding to Pi(n). 

Also, the step (c) preferably includes replacing the color vector of the central 
pixel with an average weighted by a predetermined weight that is larger for a pixel 
closer to the central pixel and is smaller for a pixel distant from the central pixel. 

The predetermined weight is preferably a value determined by a standard 
Gaussian function. 



m(n)-I 



lLw,p,(n) 



X'o (m) = 



/=0 




The color image processing method may further include the step of 
performing color quantization by weighting the color vectors of the respective pixels 
by exp(-T(n)), v>^herein T(n) is the maximum color distance within one group. 

According to another aspect of the present invention, there is provided a 
color image processing method including the steps of (a) receiving a color image 
frame and segmenting the same into a plurality of color images by a predetermined 
segmentation method, (b) sorting image pixels according to the color distance 
between the image pixels and a central pixel, with respect to an image selected 
among the segmented color images, (c) grouping the sorted pixels into groups in 
which the difference in the intragroup color distance is minimum and the difference 
in the intergroup color difference is maximum, and (d) performing filtering by 
replacing a central pixel value with a predetermined pixel value determined by pixel 
values of pixels in the groups. 

According to still another aspect of the present invention, there is provided a 
color image processing method including the steps of (a) defining a window having 
a predetermined size within an input color image, (b) selecting pixels having a color 
vector similar to that of the central pixel within the window and defining the selected 
pixels as a group, and (c) performing filtering of blurring using only the pixels within 
the defined group. 

The present invention is also embodied by a computer readable medium 
having program codes 6xecutable by a computer to perform a color image" 
processing method, the method-including the steps of (a) defining a window having 
a predetermined size within an input color image, (b) sorting image pixels according 
to the color distance between the image pixels and a central pixel, (c) grouping the 
sorted pixels into groups in which the difference in the intragroup color distance is 
minimum and the difference in the intergroup color difference is maximum, and (d) 
performing filtering by replacing a central pixel value with a predetermined pixel 
value determined by pixel values of pixels in the groups. 

Alternatively, the present invention provides a color image processing 
apparatus including sorting means for setting a window of a predetermined size 
within an input color image and sorting image pixels in the window according to the 
color distance between the image pixels and a central pixel, grouping means for 



grouping the sorted pixels into groups in which the difference in the intragroup color 
distance is minimum and the difference in the intergroup color difference is 
maximum, and filtering means for performing filtering by replacing a central pixel 
value with a predetermined pixel value determined by pixel values of pixels in the 
groups. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The above objects and advantages of the present invention will become more 

apparent by describing in detail preferred embodiments thereof with reference to the 

attached drawings in which: 

FIGS. 1 A and 1 B are flow diagrams showing a color image processing 

method according to the present invention; and 

FIG. 2 is a block diagram of a color image processing apparatus according to 

the present invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, embodiments of the present invention will be described in detail 
with reference to the accompanying drawings. 

Referring to FIG. 1A illustrating a color image processing method according 
to the present invention, a color image is input (step 100). The color image may be 
in one regi6n selected among image regions segmented by ah appropriate 
segmentation-method. 

Next, with respect to color vectors of all pixels in a LxL window in an input 
color image, the color distance cli(n) from the color vector X//?^ of a pixel positioned 
at a position n at the center of the LxL window is represented by Expression (1 ) 
(step 102): 

Distan ce(X/n),Xg(nJJ 

wherein L is an arbitrary positive integer, and assuming that /<=L^-1, / is an integer 
from 0 through K. Also, for convenience' sake of explanation, Xo(n), which 
represents the color vector of a pixel positioned at a position n at the center of the 
LxL window in an input color image, may be used to represent the corresponding 
pixel positioned at the center, that is a central pixel. 



Next, the corresponding color vectors of all pixels in the window are sorted in 
an ascending order according to the magnitude of the color distance d,(n) (step 
104). Hereinbelow, the color vectors sorted in ascending order will be represented 
byX/n;. 

5 Now, with respect to the color vectors sorted in ascending order, color 
distance difference is calculated by Expression (2) (step 106): 
fi(n)^d,^,(n)-d,(n) ^2) 

and then color vectors in which f^in) is greater than a predetermined threshold Q are 
removed (step 108). That is, the color vectors in which fin) is greater than a 
10 predetermined threshold Q are considered impulse noise to then be removed. 

According to experimental confirmation, it is more preferably to perform the step 108 
with respect to the beginning L/2 pixels and the latter L/2 pixels in ascending order, 
t: than to perform it with respect to all the (L^-1) pixels in the LxL window, except of 
^ the central pixel Xoin). 

pjis Also, according to the present invention, in order to prevent edge blurring of 

an image, filtering is performed on pixels in a peer group to be described later, 
Q rather than on all the pixels in the LxL window. The peer groups are obtained as 

□ follows. 

£ First, the pixels sorted in ascending order according to their color distance 

Cfeo from the color vector of the central pixel are divided into two groups. The first group 

consists of 0th through C/-7;th pixels, and the second group consists of rth through 

Kth pixels. 

Next, the average of the color distance differences for pixels of the first group 
and the average of the color distance differences for pixels of the second group are 
25 obtained as represented by Expressions (3a) and (3b), respectively: 

ci,(i)--Xdj(n) 

' (3a) 



.(3b) 
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and the variance of the color distance differences for pixels of the first group and the 
variance of the color distance difference for pixels of the second group are obtained 
as represented by Expressions (3c) and (3d), respectively: 

Sj(0=l\dj(n)-a/i)\' 

(3c) 



7=' 



■(3d) 



wherein / is a newly defined integer ranging from 0 through K. 

Then, using the obtained average and variance, a value J(i) represented by 
Expression (4) is calculated (step 110): 

^'^^ s](i)^s](i) 

wherein / is an integer ranging from 1 through K. The Expression (4) is based on 
Fisher's discriminant estimation method. 

Here, the actual range of / is from 1 through the numbers obtained by 
subtracting the number corresponding to color vectors of the pixels considered as 
impulse noise for removal from K. However, since the number corresponding to 
color vectors of the pixels considered as impulse noise and removed is not so large, 
it is assumed that the range of / is from 1 through K. 

Next, the value of / which makes J(i) maximum is obtained by Expression (5): 

org 

m(n)= {maxj(i)} 

(5) 

to then determine the obtained value of / as the magnitude of a peer group P(n) 
(step 112). In other words, when / is reset to variables ranging from 0 through the 
value obtained in the step 112, the peer group P(n) consists of pixels p//7| 



m(n)-l 

Y.W,p,(n) 

^'o '~ m(n)-I 

(6) 

where W, are the standard Gaussian weights corresponding to p//?; (step 1 14). 
Here, the standard Gaussian weights are determined by a standard Gaussian 
function. A pixel closer to the center of an image has a larger standard Gaussian 
weight and a pixel distant from the center has a smaller standard Gaussian weight. 
The procedure of replacing pixels in such a manner is smoothing or filtering. 

Supposing the maximum color distance in each peer group d^(n)--i(n) is T(n), 
exp(-T(n)) is applied to the color vectors of the respective pixels during color 
quantization (step 116). The maximum color distance d^(^).^(n) in each peer group 
indicates the largest value of the color distances of pixels whose number 
correspond to the size of the peer group ranging from the pixel having the minimum 
color distance, among the pixels sorted in ascending order according to their color 
distance from the central pixel. Thus, the smaller the maximum color distance 
dm(n)-i(n) in each peer group, the shorter the color distance from the central pixel, so 
that d^(^j_i(n) is an indicator of the smoothness of an image. Also, since exp(-T(n)) 
is weighted to the color vectors of the respective pixels, the pixels in smooth regions 
are more heavily weighted. than-the-pixels in highly noisy regions. Weighting the 
pixels in highly noisy regions more lightly than the pixels in the smooth regions is 
based on the analysis result of eye-perception, that is, the eye-perception is more 
sensitive to changes in detailed regions than in smooth regions. 

According to the present invention, during quantization, the value obtained by 
multiplying a predetermined constant with the average of T(n) values of all images is 
preferably used as the number of clusters. In other words, during quantization, 
fewer clusters are used in smooth regions where the T(n) value is small, and more 
clusters are used in highly noisy regions where the T(n) value is large. 

In the color image processing method according to the present invention, 
only the pixels having large color distances from the central pixel are removed, and 
then a peer group having a color vector similar to that of the central pixel is defined 




to then perform filtering thereon. Thus, edge blurring of an image rarely occurs due 
to removal and filtering of impulse noise. Also, according to the present invention, 
the information on the extent of quantization to be performed on an image can be 
obtained. 

The color image processing method is programmable by a computer 
program. Codes and code segments constituting the computer program can be 
easily derived by a computer programmer in the art. Also, the program is stored in 
computer readable media and is readable and executable by the computer, thereby 
embodying the color image processing method. The media include magnetic 
recording media, optical recording medfa, carrier wave media, and the like. 

Also, the color image processing method can be implemented on a color 
image processing apparatus. FIG. 2 is a block diagram of a color image processing 
apparatus according to the present invention. Referring to FIG. 2, the color image 
processing apparatus according to the present invention includes a segmenting unit 
200, a sorting unit 202, an impulse noise removing unit 204, a grouping unit 206, a 
filtering unit 208 and a quantizing unit 210. 

In the operation of the color image processing apparatus, the segmenting unit 
200 receives a color image frame and segments the color image frame into a 
plurality of color images by a predetermined segmentation method. 

The sorting unit 202 sets an LxL window (L is a predetermined positive 
integer.) within the color images, and sorts the pixels within the'window according to 
the color distance between each pixel and the central pixel. Thus, the sorting unit 
202 outputs color vectors of the sorted pixels. 

The impulse noise removing unit 204 removes the pixels that have a 
difference in color distance from the central pixel greater than a predetermined 
threshold, with respect to the beginning L/2 pixels and the latter L72 pixels among 
the sorted pixels. 

The grouping unit 206 receives color vectors of all the noise-removed pixels 
in the LxL window and divides the same into two groups in which the difference in 
the intragroup color distance is minimum and the difference in the intergroup color 
difference is maximum, by calculating the function represented by the Expression 
(4) using the variance and average of the color distances between the sorted pixels. 
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The filtering unit 208 performs filtering by replacing the central pixels with 
pixels in a group having a small difference from the color vector of the central pixels 
in the window. 

The quantizing unit 210 weights the color vectors of the respective pixels by 
exp(-T(n)), in which T(n) is the maximum color distance within a group having a 
small difference in the color vector from the central pixel within the window, and 
performs quantization using the value obtained by multiplying a predetermined 
constant with the average of T(n) values of all images as the number of clusters. 

In the above-described color image processing apparatus according to the 
present invention, since the pixels having large color distances from the central pixel 
are removed, a peer group having a color vector similar to that of the central pixel is 
defined to then perform filtering thereon. Thus, edge blurring of an image rarely 
occurs due to removal and filtering of impulse noise. Also, according to the present 
invention, the information on the number of clusters for quantization to be 
performed can be obtained based on the smoothness or details of an image to be 
processed. Thus, quantization-t©-can be effectively performed using the information. 

As described above, according to the present invention, in removing impulse 
noise from an image and filtering the same, the generation of edge blurring of the 
image can be reduced. 
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